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Abstract. One of the most famous conjectures in computer algebra is 
that matrix multiplication might be feasible in nearly quadratic time, [8]. 
The best known exponent is 2.376, due to Coppersmith and Winograd 

Many attempts to solve this problems in the literature work by solving, 
fixed-size problems and then apply the solution recursively [6I22I17I21I2) . 
This leads to pure combinatorial optimisation problems with fixed size. 
These problems are unlikely to be solvable in polynomial time, see [21115) . 
In 1976 Laderman published a method to multiply two 3x3 matrices using 
only 23 multiplications. This result is non-commutative, and therefore 
can be applied recursively to smaller sub-matrices. In 35 years nobody 
was able to do better and it remains an open problem if this can be done 
with 22 multiplications. 

We proceed by solving the so called Brent equations 0. We have im- 
plemented a method to converting this very hard problem to a SAT 
problem, and we have attempted to solve it, with our portfolio of some 
500 SAT solvers. With this new method we were able to produce new 
solutions to the Laderman's problem. 

We present a new fully general non-commutative solution with 23 multi- 
plications and show that this solution is new and is NOT equivalent to 
any previously known solution. This result demonstrates that the space 
of solutions to Laderman's problem is larger than expected, and therefore 
it becomes now more plausible that a solution with 22 multiplications 
exists. 

If it exists, we might be able to find it soon just by running our algorithms 
longer, or due to further improvements in the SAT solver algorithms. 
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1 Introduction 



One of the most famous problems in computer algebra is the problem of matrix 
multiplication (MM) of square and non-square matrices. 

1.1 Fast Matrix Multiplication 

For square matrices the naive algorithm is cubic and the best known theoretical 
exponent is 2.376, due to Coppersmith and Winograd [5]. This exponent is quite 
low and it is conjectured that one should be able to do matrix multiplication in 
so called "soft quadratic time" , with possibly some poly-logarithmic overheads, 
which could even be sub-exponential in the logarithm, . This in fact would be 
nearly- linear in the size of the input (!). 

In 2005 a team of scientists from Microsoft Research and two US universities 
established a new method for finding such algorithms based on group theory, and 
their best method so far gives an exponents of 2.41 [8j, very close to Coppersmith- 
Winograd result and subject to further improvement. 

It is also known that efficient algorithms for fast matrix multiplication are a 
bottleneck for many important algorithms. Any improvement in MM also leads 
to more efficient algorithms for solving a plethora of other algebra problems, such 
as inverting matrices, solving systems of linear equations, finding determinants, 
and also for some graph problems. 

1.2 Fixed Size Problems 

More or less all attempts to solve these problems in the literature rely on solving, 
once for all, certain fixed-size problems, which can be the recursively applied to 
at lower levels, to produce asymptotically fast algorithms. |6I22I17I21I2) . 

In 1969 Victor Strassen established a first asymptotic improvement to the 
complexity of dense linear algebra, by showing that two matrices 2x2 can be 
multiplied by using seven instead of eight multiplications [27] . 

Then in 1975 Laderman published a solution for multiplying 3x3 matrices 
with 23 multiplications [19]. In 35 years this topic has generated very consid- 
erable interest, see for example |22ll7ll8l25l20j yet to this day it is not clear if 
Laderman's result is optimal and if it can be improved. 

1.3 Commutative Solutions 

Makarov found an algorithm using 22 multiplications for the product of 3x3 
matrices but only in the commutative case, see [20] . 

1.4 Approximate Solutions 

Very recently Gregory Bard found an approximate solution with 22 multiplica- 
tions see [2]. An approximate solution with 21 was also found, see [24]. However 
it is much easier to find an approximate solution than an exact one. 



2 New Result 



2.1 Brent Equations 

As in many previous attempts to solve the problem we proceed by solving the 
so called Brent equations This approach has been tried many times before, 
see |6ll6l25l3l2l7j . 

We write the coefficients of each products as three 3x3-matrices for each 
multiplication A^^\ 5^*^ and C^'\ with r — 23 where A will be 

the left hand side of each product, B the right hand size, and C tells to which 
coefficient of the result this product contributes. 

The Brent equations are as follows: 

r 

For 3x3 matrixes we get 729 cubic equations exactly. 

2.2 Solving Brent Equations Modulo 2 and Lifting 

In general these equations can have rational coefficients ^16) . or even complex 
coefficients. [24] , 

We are interested only in very simple solutions which work over small finite 
rings and fields. 

First we write these Brent equations [6 modulo 2. Then we solve them mod- 
ulo 2. 

Then we start from scratch and given a solution modulo 2, we try to lift it 
by very similar formal encoding and solving methods to a solution modulo 4. 

So far a solution thus obtained seems to always be also a general solution (for 
arbitrary rings i?, and therefore also for finite fields of arbitrary characteristic). 
This is to say, we were quite lucky. 

2.3 Solving and Conversion 

Our equations are written algebraically and the converted to a SAT problem. 
Our complete equations generator with some embedded converters to SAT can 
be downloaded from [IT]. 

We have implemented a method to converting this very hard problem to a 
SAT problem, and we have attempted to solve it, with our portfolio of some 500 
SAT solvers and their variants. With many improvements and tweaks we are 
now able to obtain such a solution for 23 variables in a few days with one single 
CPU. 



2.4 The Laderman Solution From 1975 



We present it in a form which can be directly verified with Maple computer 
algebra software: 

POl := (a_l_l-a_l_2-a_l_3+a_2_l-a_2_2-a_3_2-a_3_3) * (-b_2_2) ; 
P02 := (a_l_l+a_2_l) * (b_l_2+b_2_2) ; 

P03 := (a_2_2) * (b_l_l-b_l_2+b_2_l-b_2_2-b_2_3+b_3_l-b_3_3) ; 
P04 := (-a_l_l-a_2_l+a_2_2) * (-b_l_l+b_l_2+b_2_2) ; 
P05 := (-a_2_l+a_2_2) * (-b_l_l+b_l_2) ; 
P06 := (a_l_l) * (-b_l_l); 

POT := (a_l_l+a_3_l+a_3_2) * (b_l_l-b_l_3+b_2_3) ; 
P08 := (a_l_l+a_3_l) * (-b_l_3+b_2_3) ; 
P09 := (a_3_l+a_3_2) * (b_l_l-b_l_3) ; 

PIO := (a_l_l+a_l_2-a_l_3-a_2_2+a_2_3+a_3_l+a_3_2) * (b_2_3) ; 

Pll := (a_3_2) * (-b_l_l+b_l_3+b_2_l-b_2_2-b_2_3-b_3_l+b_3_2) ; 

P12 := (a_l_3+a_3_2+a_3_3) * (b_2_2+b_3_l-b_3_2) ; 

P13 := (a_l_3+a_3_3) * (-b_2_2+b_3_2) ; 

P14 := (a_l_3) * (b_3_l); 

P15 := (-a_3_2-a_3_3) * (-b_3_l+b_3_2) ; 

P16 := (a_l_3+a_2_2-a_2_3) * (b_2_3-b_3_l+b_3_3) ; 

P17 := (-a_l_3+a_2_3) * (b_2_3+b_3_3) ; 

P18 := (a_2_2-a_2_3) * (b_3_l-b_3_3) ; 

P19 := (a_l_2) * (b_2_l) ; 

P20 := (a_2_3) * (b_3_2) ; 

P21 := (a_2_l) * (b_l_3) ; 

P22 := (a_3_l) * (b_l_2) ; 

P23 := (a_3_3) * (b_3_3) ; 

expand(-P06+P14+P19-a_l_l*b_l_l-a_l_2*b_2_l-a_l_3*b_3_l) ; 
expand(P01-P04+P05-P06-P12+P14+P15-a_l_l*b_l_2-a_l_2*b_2_2-a_l_3*b_3_2) ; 
expand(-P06-P07+P09+P10+P14+P16+P18-a_l_l*b_l_3-a_l_2*b_2_3-a_l_3*b_3_3) ; 
expand(P02+P03+P04+P06+P14+P16+P17-a_2_l*b_l_l-a_2_2*b_2_l-a_2_3*b_3_l) ; 
expand(P02+P04-P05+P06+P20-a_2_l*b_l_2-a_2_2*b_2_2-a_2_3*b_3_2) ; 
expand(P14+P16+P17+P18+P21-a_2_l*b_l_3-a_2_2*b_2_3-a_2_3*b_3_3) ; 
expand(P06+P07-P08+Pll+P12+P13-P14-a_3_l*b_l_l-a_3_2*b_2_l-a_3_3*b_3_l) ; 
expand(P12+P13-P14-P15+P22-a_3_l*b_l_2-a_3_2*b_2_2-a_3_3*b_3_2) ; 
expand(P06+P07-P08-P09+P23-a_3_l*b_l_3-a_3_2*b_2_3-a_3_3*b_3_3) ; 



2.5 The New Method with 23 Multiplications 



We present it in the same form which can also be directly verified with Maple 
computer algebra software: 

POl := (a_2_3) * (-b_l_2+b_l_3-b_3_2+b_3_3) ; 

P02 := (-a_l_l+a_l_3+a_3_l+a_3_2) * (b_2_l+b_2_2) ; 

P03 := (a_l_3+a_2_3-a_3_3) * (b_3_l+b_3_2-b_3_3) ; 

P04 := (-a_l_l+a_l_3) * (-b_2_l-b_2_2+b_3_l) ; 

P05 := (a_l_l-a_l_3+a_3_3) * (b_3_l) ; 

P06 := (-a_2_l+a_2_3+a_3_l) * (b_l_2-b_l_3) ; 

POT := (-a_3_l-a_3_2) * (b_2_2) ; 

P08 := (a_3_l) * (b_l_l-b_2_l) ; 

P09 := (-a_2_l-a_2_2+a_2_3) * (b_3_3) ; 

PIO := (a_l_l+a_2_l-a_3_l) * (b_l_l+b_l_2+b_3_3) ; 

Pll := (-a_l_2-a_2_2+a_3_2) * (-b_2_2+b_2_3) ; 

P12 := (a_3_3) * (b_3_2) ; 

P13 := (a_2_2) * (b_l_3-b_2_3) ; 

P14 := (a_2_l+a_2_2) * (b_l_3+b_3_3) ; 

P15 := (a_l_l) * (-b_l_l+b_2_l-b_3_l); 

P16 := (a_3_l) * (b_l_2-b_2_2) ; 

P17 := (a_l_2) * (-b_2_2+b_2_3-b_3_3) ; 

P18 := (-a_l_l+a_l_2+a_l_3+a_2_2+a_3_l) * (b_2_l+b_2_2+b_3_3) ; 

P19 := (-a_l_l+a_2_2+a_3_l) * (b_l_3+b_2_l+b_3_3) ; 

P20 := (-a_l_2+a_2_l+a_2_2-a_2_3-a_3_3) * (-b_3_3) ; 

P21 := (-a_2_2-a_3_l) * (b_l_3-b_2_2) ; 

P22 := (-a_l_l-a_l_2+a_3_l+a_3_2) * (b_2_l) ; 

P23 := (a_l_l+a_2_3) * (b_l_2-b_l_3-b_3_l) ; 

expand(P02+P04+P07-P15-P22-a_l_l*b_l_l-a_l_2*b_2_l-a_l_3*b_3_l) ; 
expand(P01-P02+P03+P05-P07+P09+P12+P18-P19-P20-P21+P22+P23- 

a_l_l*b_l_2-a_l_2*b_2_2-a_l_3*b_3_2) ; 

expand(-P02-P07+P17+P18-P19-P21+P22-a_l_l*b_l_3-a_l_2*b_2_3-a_l_3*b_3_3); 
expand(P06+P08+P10-P14+P15+P19-P23-a_2_l*b_l_l-a_2_2*b_2_l-a_2_3*b_3_l) ; 
expand(-P01-P06+P09+P14+P16+P21-a_2_l*b_l_2-a_2_2*b_2_2-a_2_3*b_3_2) ; 
expand(P09-P13+P14-a_2_l*b_l_3-a_2_2*b_2_3-a_2_3*b_3_3) ; 
expand(P02+P04+P05+P07+P08-a_3_l*b_l_l-a_3_2*b_2_l-a_3_3*b_3_l) ; 
expand(-P07+P12+P16-a_3_l*b_l_2-a_3_2*b_2_2-a_3_3*b_3_2) ; 
expand(-P07-P09+Pll-P13+P17+P20-P21-a_3_l*b_l_3-a_3_2*b_2_3-a_3_3*b_3_3); 



3 Equivalent Solutions 



An important question is as follows: can our solution be obtained from the 
Laderman's solution? 

Equivalence relations and the group of transformations which allow to trans- 
form one exact non-commutative solution for matrix multiplication, into another 
such solution, have been studied in |16I13| . 

We give here a brief description of transformations in question: 

As in [16] we write the coefficients of each products as three 3x3-matrices for 
each multiplication i?*^*^ and C*^*\ 1 < « < with r = 23 where A will be 
the left hand side of each product, B the right hand size, and C tells to which 
coefficient of the result this product contributes. 

We have the following transformations which transform one solution to an- 
other solution: 

1. One can permute the r indexes i. 

2. One can cyclically shift the three sets of matrices, A^'^ B^*) and C^'^ for 
l<i<r becomes B'^\C'^^ and A^^ for 1 < i < r. 

3. One reverse the order and transpose: A'^'^S'*^ and C^*-' for 1 < i < r 
becomes {C^^Y , (SW)"^ and [A^'^Y for 1 < i < r. 

4. One can rescale as follows: aiA^'^\biB''^^ and CiC'^^^ for 1 < i < r where 
aj, 6i, Ci are rational coefficients with aibid = 1 for each 1 < i < r. 

5. This method is called "sandwiching". We replace A*^*-', i?'*^ and C*-'-* for 1 < 
i < r by UA'^^'>V-\ VB^'^W'^ and VFCWC/"!, 

where U, V, W are three arbitrary invertible matrices. 

Main results in this area of concern to us can be summarized as follows: for the 
2x2 case and 7 multiplications, all non-commutative algorithms are equivalent 
to Strassens algorithm, see [16113) . 

For 3x3 matrices and 23 multiplications, Johnson and McLoughlin have in 
1986 exhibited two families of infinitely pairwise inequivalent algorithms, see 
[16] . Now the main question is, is our solution new, or already found in [16] . 



4 Comparison 



4.1 Is Our Solution Equivalent To Any Previous Solution? 

An important question is as follows: can our solution be obtained from the 
Laderman's solution or from one of the solutions from |16j . 
To prove inequivalence, we follow the methodology of [T6] . 

Theorem 4.1.1 (Invariant for Equivalent Solutions). It is possible to see, 
that all the transformations described on the previous page, leave the distribution 
of 3 X r ranks of matrices inchanged, except that these integers can be permuted. 
Proof: This is obvious and was already stated in |16| . 

Theorem 4.1.2. Our new solution from Section [^31 is neither equivalent to the 
Laderman's solution from Section 12.41 nor it is to any of the solutions given in 

m- 

Proof: Following [TB], the Laderman's solution has exactly 6 matrices of rank 3 
(which occur in products P01,P03,P06,P10,P11,P14 in Section HH). 

At the same time in all new solutions presented in |16| , at most 1 matrix will 
have rank 3. 

In our solution we have exactly 2 matrices of rank 3 (which occur in products 
P18 and P20, they are 2 and not more such matrices, both being on the left hand 
size namely A^^^\ in A'^^^\ and we have checked carefully, there is no mistake). 

This proves that all these solutions are distinct. 



5 Conclusion 



One of the most famous problems in computer algebra is the problem of fast 
matrix multiplication. The progress in this area is very slow. Many attempts to 
solve these problems in the literature work by solving, fixed-size problems and 
apply the solution recursively }6l22ll7l21l2j . This leads to pure combinatorial 
optimisation problems with fixed size. 

In 1976 Laderman published a general and non-commutative method to mul- 
tiply two 3x3 matrices using only 23 multiplications. In 35 years very little no 
progress was made on this very famous problem and until this day it remains an 
open problem if this can be done with 22 multiplications. 

We have implemented a new method which converts this very hard problem 
to a SAT problem, and we have attempted to solve it, with our portfolio of some 
500 SAT solvers. We were able to produce new solutions to the Laderman's 
problem. We present a new fully general and non-commutative solution with 
also 23 multiplications. We prove that this new solution is NOT equivalent 
to the Laderman's original solution, neither it is equivalent to any of the new 
solutions given in |16l. In fact it is very different. 

This preliminary result gives strong evidence that the space of solutions to 
Laderman's problem is larger than expected, and therefore it is worth trying 
to find more such solutions. It further increases the chances that a solution for 
22 multiplications exits and it might be found soon by running our algorithms 
longer, or just by using better SAT solvers. This also motivates further research 
about SAT solvers and their applications in mathematics and computer science. 
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